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Abstract. The main purpose of this paper is to provide a comprehensive convergence analysis 
of a nonlinear AMLI-cycle multigrid method for symmetric positive definite problems. Based on 
classical assumptions for approximation and smoothing properties, we show that the nonlinear AMLI- 
cycle MG is uniformly convergent. Furthermore, under the only assumption that the smoother is 
convergent, we show that the nonlinear AMLI-cycle is always better (or not worse) than the respective 
V-cycle MG. Finally, numerical experiments are presented to support the theoretical results. 
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1. Introduction. In this paper, we consider the following large-scale sparse lin- 
ear system of equations 

(1.1) Au = f, 

where A is a symmetric positive definite (SPD) operator on a finite-dimensional vector 
space V. Development of efficient and practical solvers for large sparse linear system 
of equations arising from discretizations of partial differential equations (PDEs) is 
an important task in scientific and engineering computing. We consider iterative 
solution of equation ([l.ljl by multigrid (MG) methods. MG methods are efficient and 
often have optimal complexity. There is extensive literature on MG methods; see 
[121 [261 EH El [91 ESI EH ES] , and references therein for details. MG methods are quite 
successful in practical applications nowadays. Due to their efficiency and scalability, 
MG methods, especially their algebraic variants, algebraic multigrid (AMG) methods, 
have become increasingly used in practice. AMG, originated in [6], gained some 
popularity after |19j appeared, and more recently have been further extended and 
developed in various directions (O QUI EH [T4] , etc.). 

In order to improve the robustness of (A)MG methods, we usually use them 
as preconditioners in Krylov subspace iterative methods |__Q], such as the conjugate 
gradient (CG) method in the case when A is SPD. 

The performance and efficiency of MG methods may degenerate when the physical 
and geometric properties of the problems become more and more complicated. Gen- 
erally speaking, if the convergence factor of the two-grid method is too large, the fast 
convergence property of the MG methods, which is expected to be independent of the 
levels, can not be guaranteed with standard V- and even W-cycles. A multilevel cycle, 
which uses the best polynomial approximation of degree n to define the coarse level 
solver, was originally introduced in [U [2J [24] and applied to the hierarchical basis MG 
method. This cycle, which usually is referred to as the algebraic multilevel iteration 
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(AMLI) cycle, is designed to provide optimal condition number, if the degree n of the 
polynomial is sufficiently large, under the assumption that the V-cycle MG methods 
have bounded condition number that only depends on the difference of levels. This 
assumption (on the bounded level length V-cycle convergence) is feasible for certain 
second order elliptic PDEs without additional assumptions on PDE regularity. 

More recently, thanks to the introduction of the nonlinear (variablc-step/fiexible) 
preconditioning method and its analysis in [3] (see also [TTJ [T7J [SO] > etc.), the nonlin- 
ear multilevel preconditioners were proposed and their additive version was analyzed 
in [4]. Furthermore, in [13], the multiplicative version was investigated. In these 
nonlinear multilevel preconditioners, n steps of a preconditioned CG iterative method 
replaces the best polynomial approximation and is performed to define the coarse 
level solvers. The condition number is optimal for properly chosen n > 1. The same 
idea can be adopted to define the MG cycles and has been introduced in [25]. The 
resulting nonlinear AMLI-cycle MG was analyzed in [T5] (see also [25]). In nonlinear 
AMLI-cycle MG, n steps of a CG method with MG on the coarser level as a precon- 
ditioncr is applied to define the coarse level solver. Under the assumption that the 
convergence factor of the V-cycle MG with bounded-level difference is bounded, the 
uniform convergence property of the nonlinear AMLI-cycle MG methods is shown, if 
n is chosen to be sufficiently large. 

As we can see, the parameter n plays an important rule in the linear and nonlinear 
AMLI-cycle MG methods. It needs to be sufficiently large to guarantee the uniform 
convergence even for the problems with full regularity according to the theoretical 
results. However, one can expect the uniform convergence for these cases for any 
n G Z + , especially n — 1, which partly motivated the present work. More specifically, 
we provide such uniform convergence analysis of the nonlinear AMLI-cycle MG. Under 
the standard assumptions on approximation and smoothing properties, we show that 
both nonsymmetric (without post-smoothing) and symmetric (with both pre- and 
post-smoothing) nonlinear AMLI-cycle MG converge uniformly for any n > 1 in the 
following sense: 

\\v-Br[A k v]\\ 2 Ak <6\\v\\ 2 Ak , 
\\v-B k [A k v]\\\ k <6\\v\\l k , 

where B% s and B k , defined by Algorithm ^. 41 and !2.5l below. denote the nonsymmetric 
and symmetric nonlinear AMLI-cycle MG methods respectively, and the constant 
< S < 1 is independent of the level k. We also give an alternative proof of the 
uniform convergence under the assumption used in |18j , i.e. the boundedness of V- 
cycle MG with bounded- level difference. In addition, we show that B'£ s [-] and B k [-], 
the preconditioners used in Krylov subspace iterative methods to define and 
Bk[-], are also uniformly convergent. This means all the recursive calls of Krylov 
subspace iterative methods can be done only on the coarse levels. On the finest level, 
we can only do the smoothing steps and still have a uniform convergent method. On 
the other hand, without the approximation and smoothing properties, similar to MG 
methods, we are not able to show the uniform convergence for nonlinear AMLI-cycle 
MG. However, we can compare nonlinear AMLI-cycle MG with V-cycle MG methods, 
and show that nonlinear AMLI-cycle MG is always better than the corresponding V- 
cyclc MG for any n > 1. For nonsymmetric case, we can show that 

\\v-B^[A k v]\\ Ak <\\v-BrA k v\\ Ak) 
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where B k s denotes the nonsymmetric V-cycle MG (without post-smoothing), i.e. \ cy- 
cle. For the symmetric case, under the assumption that the smoother is convergent 
in || • [| ^ norm, we have 

||v - B k [A k v]\\ Ak < \\v - B k A k v\\ Ak , 

where B k denotes the V-cycle MG. The above inequality is based on an important 
property of the full version of nonlinear preconditioned conjugate gradient (PCG) 
method, namely, the residual of the current iteration is orthogonal to all previous 
search directions. This property fails for the truncated version of nonlinear PCG 
method. Therefore, the full version nonlinear PCG should be used rather than the 
steepest descent method or any truncated version of the nonlinear PCG to define the 
coarse level solver in the nonlinear AMLI-cycle MG. 

The rest of the paper is organized as follows. In section 2, we introduce the 
nonlinear AMLI-cycle MG algorithms and the basic assumptions. The main results, 
uniform convergence and comparison theorem of nonlinear AMLI-cycle MG are pre- 
sented in section 3. In section 4, numerical experiments and the results that illustrate 
our theoretical results are presented. 

2. Preliminaries. Let V be a linear vector space. (•, •) denotes a given inner 
product on V; its induced norm is || • ||. The adjoint of A with respect to (■,■), 
denoted by A\ is defined by (Au,v) = (u,A t v) for all u,v G V, A is SPD if A 1 = 
A and (Av, v) > for all v G V^\{0}. Since A is SPD with respect to (•, •), (-4-, •) defines 
another inner product on V, denoted by (•, -) A , and its induced norm is || • H^. 

2.1. Multigrid. Let us first introduce the standard V-cycle MG method. Here, 
we consider the MG methods which are based on a nested sequence of subspaces of V: 

(2.1) V x C V 2 C • • • C Vj = V. 

Corresponding to these spaces, we define Q k , P k : V — > V k as the orthogonal pro- 
jections with respect to (•, •) and (•, -)a respectively, and define A k : Vk — >■ Vk by 
(A k u k ,v k ) — {u k ,v k )A for u k ,v k G V k . Note that A k is also SPD, and therefore 
defines a inner product on 14, denoted by (•, -) Ak , and its induced norm is || • \\A k - 
We also need to introduce a smoother operator Rf, : V k — > 14 in order to define the 
multigrid method. 

Now we define the nonsymmetric multigrid iterator B 7 k ls (without post-smoothing) 
by the following recursive algorithm: 



Algorithm 2.1 \-cycle MG: B" s 

Let B™ s = A^ 1 and assume that B^t 1 : V k -i — > V k -i has been defined, then 
for / G V k , B% s : V k ->■ V k is defined as follow: 
Pre-smoothing: u\ — R k f\ 

Coarse grid correction: B k ls f :— u\ + B^tiQk-xif — A k u\). 



Similarly, we can also define the (symmetric) V-cycle multigrid operator B k re- 
cursively as shown in Algorithm 12.21 

2.2. Nonlinear Preconditioned Conjugate Gradient Method. In order 
to introduce nonlinear AMLI-cycle, we also need to introduce the nonlinear PCG 
Method, which is a simplified version (available for s.p.d. A k ) of the algorithm orig- 
inated in [3]. The original version in [3] was meant for more general cases including 
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Algorithm 2.2 V-cyclc MG: B k 

Let B\ = Ai 1 and assume that B k -\ : V k -i — > V k -\ has been defined, then 
for / G Vfe, B k : V k — > V k is defined as follow: 
Pre-smoothing u\ = R k f; 

Coarse grid correction u 2 = u\ + B k _\Q k _i{f — A k u\); 
Post-smoothing B k f := u 2 + R\(f - A k u 2 ). 



nonsymmetric and possibly indefinite matrices. Let B k [-] : V k — > V k be a given non- 
linear operator that is intended to approximate the inverse of A k . We now formulate 
the nonlinear PCG method that can be used to provide iterated approximate inverse 
to A k based on the given nonlinear operator £?&[•]• This procedure gives another non- 
linear operator B k [-] : V k — > V k , which can be viewed as an improved approximation 
to the inverse of A k . 

Algorithm 2.3 Nonlinear PCG Method 

Assume we are given a nonlinear operator B k [-] to be used as a preconditioner. 
Then, for V/ e V k , B k [f] is defined as follows: 

Step 1. Let uo — and ro = /. Compute po — B k [ro\- Then let 

iti = aopo, and r± = ro — aoA k po, where ao = 



iPO,Po)A k ' 

Step 2. For i = 1,2, - • ■ ,n — 1, compute the next conjugate direction 
(2.2) Vl = B k \ Tl \ + £ fcpj, where fa = J B Mp^ . 

j =Q (Pj>Pj)A k 

Then next iterate is 

in, Pi) 



(2.3) u i+1 =Ui + a,p l7 where a» 



{Pi,Pi)A k ' 
and the corresponding residual is 

(2.4) r i+1 =n- onA k pi. 

Step 3. Let B k [f] := u n . 

Remark 2.1. If we only apply one step of nonlinear PCG method, we can see that 

(Bk [/],/) 



(2.5) B k [f] = aB k [f], where a 



\B k [f]\\ 2 Ak 



That is, B k [f] differs from B k [f] by a scalar factor. 

Remark 2.2. Due to the choice of fti j, it is easy to see that the new direction Pi 
is orthogonal to all the previous directions Pj, j = 0, 1, ■ • ■ , i — 1, namely 



(2.6) 



(Pi,Pj)A k = 0, i = 0, 1, 2, • • • ,i - 1. 
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Due to this property of the directions pi and the choice of a,, from (I2.4[) . it is straight- 
forward to see that 

(2.7) (r i+1 , Pj ) = 0, j = 0,1,2,-.. ,i. 

Finally, by (12.61) and (|2.7[) , we can show that Ui+i computed by (|2.3p is the solution 
of the following minimization problem 

i 



3=0 



Therefore, we have 



\\f - A k Ui+i\\ 2 A -i < ||/ - A kUi \\ A . 



then by induction, we have 



(2-8) \\A^.f-B k [f]\\A k < WA^f-MfWlX 



This means, that B k [-} is a better approximation to A^ 1 than !?&[■]. 

Remark 2.3. According to equation (|2.2[) . we use all previous search directions to 
compute the next one. The resulting Algorithm 12. 31 is referred to as the full version of 
nonlinear PCG method. In practice, due to the memory constraints, we may want to 
use a truncated version; namely, we only require that the new direction be orthogonal 
to the rrii > most recent ones (cf. [T7]). In that case, equation (I2.2[) is replaced by 



_(B k [r i ],p j )A k 

^Ijfjl VV11C1C ^ij — 

j—i — l—mi 



(2.9) Pi = B k [n]+ ^2 PijPj, where p id — - 

(Pj i Pj j 



and the resulting algorithm is called the truncated version of nonlinear PCG method. 
A general strategy is to have < m t <mi_i + l < i — 1 and a typical choice is rrn = 0. 
If pi — B k [ri] (i.e., formally rrii = —1) this choice corresponds to the nonlinear 
preconditioned steepest descent method. In the present multilevel setting the full 
version of the method is practically acceptable, since we expect to have relatively few 
recursive calls (between the levels) and this happens on coarse levels. 

If B k {-\ approximates the inverse of A k , with accuracy S 6 [0, 1), that is, 

(2.10) llV/-^[/]IU fc <^ll/IU- 1 . 

We will later use the following convergence results of the nonlinear PCG methods. 

Theorem 2.1 (Theorem 10.2, [25]). Assume that B k [-] satisfies (|2.10p . and B k [-} 
is implemented by n iterations of Alaorithm \2.3\ with B k [-\ as the preconditioner, then 
the following convergence rate estimate holds, 

(2.11) llV/-^[/]IU,<^ll/IU- 1 - 



Remark 2.4- As stated by Theorem 10.2 in [2S], the above convergence rate esti- 
mate holds for both full and truncated version of the nonlinear PCG methods. 
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Algorithm 2.4 Nonsymmetric nonlinear AMLI-cycle MG: -BP S [-] 

Assume Bf s [f] = A^ 1 f ', and B^l^-} has been denned, then for / e V k 
Pre-smoothing: u% — Rkf', 

Coarse grid correction: B k s [f] := u\ + B k tx[Qk-i(f — A k ui)], 
where B k t 1 is implemented as in Algorithm 12.31 with B2ti as preconditioner. 



2.3. Nonlinear AMLI-cycle MG. Now, thanks to Algorithm E21 we can 
recursively construct the nonlinear AMLI-cycle MG operator as an approximation 

First, we define a nonsymmetric one, i.e. a nonlinear AMLI-cycle MG without 
post-smoothing as shown in Algorithm 12.41 

Similarly to standard (linear) MG, we can also define a symmetric nonlinear 
AMLI-cycle multigrid by introducing post-smoothing as shown in Algorithm 12.51 



Algorithm 2.5 Nonlinear AMLI-cycle MG: B k [] 

Assume Bi[f] = ^j -1 /, and B k _i\-] has been defined, then for / e V k 
Pre-smoothing u\ = Rkf] 

Coarse grid correction u 2 = u\ + Bk-i[Qk-i(f — AkUi)}, where Bk-i is 
implemented as in Algorithm 12.31 with -Bfc-i as preconditioner; 
Post-smoothing B k [f] := u 2 + R\(f - AkU 2 ). 



2.4. Assumptions. Our goal is to analyze the convergence of the nonlinear 
AMLI-cycle MG using the same assumptions as in the conventional (classical) con- 
vergence analysis of MG. 

We make the following (classical) assumptions in order to carry out the conver- 
gence analysis. These assumptions will be used to show the uniform convergence 
of the nonlinear AMLI-cycle. The first assumption is the so-called approximation 
property of the projection P k . 

ASSUMPTION 2.1 (Approximation Property) . 

(2-12) \\{I - P^MW k < ^-\\A k v\\\ Vv€V k , 

P{Ak) 

where p(A k ) is the spectral radius of A k , and c\ is a constant independent of k. This 
assumption is commonly used in the MG literature, for example, Assumption A. 7 
in [5], "strong approximation property" assumption in [25], and Assumption (A7.1) 
in [26]. The above assumption holds (see, e.g., [26] [25]) in the case of second order 
elliptic problems with full regularity. 

A next common assumption is on the smoothers. In this paper, we always assume 
that the (nonsymmetric, in general) smoother R k , is convergent in the || • norm. 

Our second main assumption is that the symmetric composite smoother R k , de- 
fined by 

/ - R k A k = (I- R k A k ){I - R l k A k ), 

satisfies the following smoothing property. 
Assumption 2.2 (Smoothing Property). 

(2.13) ^L^^ v )<( RkVjV \y v€Vk , 

p{Ak) 
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where c 2 is a constant independent of k. This assumption means that the choice of 
smoother must be comparable to a simple Richardson smoother. It is used to prove 
estimates concerning V-cycle MG, see Assumption A. 4. in [5]. Note that, we also 
have another symmetric composite smoother R k which is defined by 

/ - R k A k = (I - R{A k )(I - R k A k ). 

Based on the two Assumptions 12.11 and 12. 2[ we have the following (well-known) 
result (see p. 75 of [55] and p. 145 of [25] ) 

Lemma 2.2. Assume that Assumvtions \2~J\ and [K2l hold, then we have 

(2.i4) W-P k -i)n 2 A k <v(\H 2 A k -\H 2 A h ), 

where v = ( I — R k A k )v, v £ V and n = — > is a constant independent of k. 

Remark 2.5. The above Lemma can be found as Assumption (A) in |25) and 
Lemma 6.2 in [26 . It provides perhaps the shortest convergence proof for the V-cycle 
MG. It is also equivalent to the assumption originally used in [T5l US], see [25] for 
details. Inequality (|2.12|) can also be found as inequality (4.82) in [21"] . 

3. Convergence Analysis. In this section, we present the main results of this 
paper. Based on Assumptions 12.11 and 12.21 we show that nonlinear AMLI-cycle MG is 
uniformly convergent without the requirement that n, the number of iterations of the 
nonlinear PCG method, be sufficiently large. Furthermore, without these assump- 
tions, we can also compare nonlinear AMLI-cycle MG with V-cycle MG, and show 
that the nonlinear AMLI-cycle MG is always better or not worse than the respective 
V-cycle MG. 

The following two representations are useful in our analysis. First, we have a 
result for the nonsymmetric nonlinear operator -B£ s [-] defined in Algorithm 12.41 
Lemma 3.1. For all v 6 V k 

(3.1) v-B^[A k v] = {I - R k A k )v - B^AAk-iPk-iil - RkA k )v], 
and 

(3.2) B% s [v}=R k v + Bl s _ l [Q k _ l {I-A k R k )v]. 

Proof. Properties (|3.1I) and (|3.2j) follow directly from Algorithm 12.41 and the 
identity A k -iP k -i — Q k ^\A k that holds on V k . □ Similarly, we have the following 
lemma concerning the (symmetric) nonlinear operator B k defined in Algorithm 12.51 

Lemma 3.2. For all v 6 V k 

(3.3) v - B k [A k v] = (I- RlA k )((I - R k A k )v - B k _ 1 [A k -. 1 P k .. 1 (I - R k A k )v]), 
and 

(3.4) B k \v} = R k v + {I-R t k A k )B k - 1 [Q k - X {I-A k R k )v\. 

Proof. Properties (13.31) and (|3.4[) are also seen directly from the definition in 
Algorithm 12.51 (using again the identity A k _\P k _\ = Q k -\A k that holds on V k ). □ 
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3.1. Uniform Convergence. Firstly, we prove the uniform convergence of the 
nonsymmetric nonlinear AMLI-cycle MG method. 

Theorem 3.3. Let B r k LS [-\ be defined by Algorithm \2.J\ and B k s [] be imple- 
mented as in Algorithm \2.3\ with B k s [-] as preconditioner. Assume that Assump- 
tions [2~l\ and UJTB hold, then we have the following uniform estimates 



(3-5) \\v-Br[A k v}\\i h <6\\v\\l k , 
(3-6) \\v-Br[A k v]\\\ k <5\\v\\\ kl 

where 5 = Cl c + C2 < 1, which is a constant independent of k. 

Proof. We prove this by mathematical induction. Assume (|3.5[) and (13.61) hold 
for k — 1, and let v = (I — R k A k )v. By Lemma 1331 we have 

v - B% s [A k v] =v- P k -±v + P k _ lV - B^Mk-iPk-iv]. 

Since P k ~i is a projection, we have 

(3.7) 



\\v - B^[A k v]\\\ k = \\v - P k - X v\\\ k + \\P k _iv - B^A^P^v] 
(Induction Assumption) < \\v — P k -iv\\ 2 Ak + S\\P k -iv li2 



(Orthogonality) - (1 - S)\\v - P fe -iw||l + S\\v\\ 2 



(LemmalHD < (1 - 5)r,(\\vf Ah - \\v\\ 2 Ak ) + S\\v\\ 2 Ak 
= (l-SH\v\\ 2 Ak +(5-(l-S)r 1 )\\v\\ 2 Ak 



(Choose 6 = -J- = — = S\\v\\X 

Then (I3.5[) follows. Moreover, since B 7 k ls [A k v] is obtained by Algorithm ^. 31 with 5J? S [-] 
as preconditioner, by (|2.8|). we have 

(3.8) \\v-BnAkv}\\ 2 Ak < \\v-BnA k v}\\ 2 Ak <S\\v\\ 2 Ak . 

This completes the proof. □ 

In the next theorem we study the convergence of the symmetric nonlinear AMLI- 
cycle MG under Assumptions 12.11 and 12.21 

Theorem 3.4. Let B k [] be defined by Algorithm \2.b\ and B k s [-] be imple- 
mented as in Algorithm \2.3\ with B k [-\ as the preconditioner. Assume that Assump- 
tions [2~1\ and UTB hold, then we have the following uniform estimates 

(3-9) \\v - B k [A k v]\\ 2 Ak < S\\v\\ 2 Ak , 

(3-10) \\v ~ B k [A k v]\\ 2 Ak < 6\\v\\ 2 Ak , 

where 8 — c + e < 1 is a constant independent on k. 

Proof. Assume that (I3.9[) and p. 101) hold for k — 1. Denote (/ — R k A k )v by v as 
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before. Then by Lemma 13.21 we have 

(v - B k [A k v],w)A k = (v - B k -i[A k -iPk-iv] ,w) Ak 

= (v - Pk-iv + Pk-iv - B k _i[A k -iPk-iv],w)A k 

= (v - Pk-lV, w) Ak + (Pk-lV ~ Bk-l[Ak-lPk-lv],U>)A k 

= (v - Pk-iv, w - P k -iw) Ak 

+ (Pk-iv - Bh-i[A k -iPk-iv], Pk-iw)A k 
(Cauchy Schwarz) < ||« - P k -iv\\ Ak \\w - P k -iw\\ Ak 

+ \\Pk-iv - B k - 1 [A k - 1 P k - 1 v}\\ Ak \\P k _ 1 w\\ Ak 
(Induction Assumption) < ||« — Pfc-iwH^j, \\w — P k -iw\\A k 

+ 6 1 / 2 \\Pk-lv\\A k \\Pk-lw\\A k 

(Cauchy Schwarz) < yj\\v - P k -iv\\ 2 Ak + 5\\P k -iv\\ 2 Ak 

x ^\\w-Pk-iM\ 2 A h + \\ p k~iw\\ Ak 

For the first term, we can use the same argument in Theorem 13.41 The second 
term can be estimated using the orthogonality of Pk-i and the assumption that the 
smoother R k is A^-convergent. Therefore, we have 

(v-Bk[Akv],w) Ak <S 1,2 \\v\\A k \\w\\A k , d = r,/( V + l). 

This shows that \\v — -Bfcf^fcv] ||A fc < S 1 / 2 \\v\\ Ak with S = 77/(77 + 1), and hence 
(|3.9P follows by mathematical induction. 

Note that B k [A k v] is obtained by Algorithm [2]3] with B k [-] used as preconditioner, 
hence by (|2.8[) . we have 

\\v - B k [A k v]\\ 2 Ah < \\v - Bk[A k v}\\ 2 Ah , 

Then (|3~10l) follows directly. □ 

In Theorem 13.31 and 13. 4[ the full version of the nonlinear PCG was (implicitly) 
assumed. However, it is clear that since we only use the minimization property (|2.8p in 
the proof, the final result also holds for any truncated version of the nonlinear PCG. 
Therefore, we have the following two corollaries regarding the uniform convergence of 
the nonlinear AMLI-cycle MG using truncated versions of the nonlinear PCG. 

Corollary 3.5. Let B k s [-] be defined by Algorithm \2.4\ and B k s [-] be imple- 
mented in a truncated version of Alaorithm \2.3\ with B^ s [-] as preconditioner. Assume 
that Assumptions [2~l\ and \2.2\ hold, then we have the following uniform estimates 

(3-11) \\v-BZ s [Akv]\\ 2 Ah <5\\v\\ 2 Ah , 
(3-12) \\v-Br[A k v]\\ 2 Ak <8\\v\\ 2 Ak , 

where 5 = c ^ C9 < 1 is a constant independent on k. 

COROLLARY 3.6. LetB k [-] be defined by Alaorithm UTR andB k ls [-] be implemented 
in a truncated version of Algorithm \2.3\ with B k [-] as preconditioner. Assume that 
Assumvtions [2~l\ and \2~2] hold, then we have the following uniform estimates 

(3-13) \\v-Bk[A k v}f Ak <S\\v\\ Ak , 
(3-14) \\v-Bk[A k v]\\ 2 Ak <6\\v\\ 2 Ak , 
where 5 — c ^_ Co < 1 is a constant independent on k. 
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Remark 3.1. In [T8], uniform convergence of nonlinear AMLI-cycle MG is shown if 
the number of nonlinear PCG iterations is chosen to be sufficiently large (under certain 
assumption on the boundedness of the V-cycle MG with bounded-level difference). 
However, this condition is not needed in the above theorems. Our uniform convergence 
results hold for arbitrary choice of the number of nonlinear PCG iterations but requires 
instead Assumptions 12.11 and 12.21 

3.2. Convergence results without Assumptions [2TT1 and 1 2.21 So far, the 
convergence results suggest that not only Bk [•] but also Bk [•] converge uniformly under 
Assumption 12.11 and 12 . 2 1 A natural question arises, under the same assumption on the 
bounded convergence factor of the V-cycle MG with bounded- level difference, fco, used 
in [18j . does the nonlinear operator B k [ m ] converge uniformly when n is sufficiently 
large? The following two theorems give a positive answer to this question. This is a 
(slight) generalization of the result in [T8] . 

For the sake of simplicity, let us assume that the convergence factor of two-grid 
method (fco = 1) is independent of fc. The more general case, when the convergence 
factor of V-cycle MG with bounded-level difference fco is independent of fc, can be 
analyzed similarly. 

Theorem 3.7. Let B% s [-] be defined by Algorithm \2.4\ and B%"[-] be implemented 
as in Algorithm ic. 3\ with Bu s [-] as preconditioner. Assume that the convergence factor 
of two-grid method is bounded by S € [0, 1) which is independent of k, Let n, the 
number of iterations of the nonlinear PCG method, be chosen such that the following 
inequality 

(3.15) (l-S n )S + S n <S, 

has a solution S e [0, 1). A sufficient condition for this is 

(3.16) n > ^-L. 

then we have the following uniform estimates 

(3-17) \\v-BnA k v]f Ak <S\\vf Ak , 
(3-18) \\v-BnA k v]\\ Ak <S n \\vf Ak , 

where 5 is independent ofk. 

Proof. We prove the estimates by mathematical induction. Assume that (|3.17p 
and p. 181) hold for fc — 1, and let v = (I — RkAk)v. Similar to Theorem l3.3[ we have 

\\v-Br[A k v]f Ah = \\v-P k - 1 v\\\ k 

+ \\P k . 1 v-BZ 1 [A k -iP k - 1 v]\\A h 
(Induction Assumption) < \\v - P k -iv\\ Ak + S n \\P k -iv\\ Ak 

(orthogonality) - (1 - S n )\\v - P k -tvf Ak + 6 n \\v\\ Ak 

(two-grid convergence factor is bounded) < ((1 — 5 n )S + S n )\\v\\ A 

(by @23) < 5\\v\\ Ak . 

This shows that estimate p.!7[) holds. Moreover, According to Theorem 12. 1[ and 
letting / = A k v in (12. lip , the estimate (|3.18[) follows directly. 
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Now we show that (|3.16[) implies that there exists a (5 which solves (|3.15[) . (|3.15[) 
is equivalently to 

(f>(5) = (1 + S + S 2 + --- + S^S -(S + S 2 + --- + S'"- 1 ) < 0. 

Due to (GUI!]), <j){l) = n8- (n - 1) = 1 - n(l - 8) < 0, and 0(0) = 8 > 0. therefore, 
there is a 5* G [0, 1) such that <f>(8*) = 0. Then any 8 E [8*, 1) will satisfy (j3~T5i □ 

Similar result also holds for symmetric case, see the following theorem. 

Theorem 3.8. Let B k [-\ be defined by Alaorithm \2.5[ and B^[-\ be implemented 
as in Algorithm ic. S\ with Bk[-] as preconditioner. Assume that the convergence factor 
of two-grid method is bounded by 8 £ [0, 1) which is independent of k, Let n, the 
number of iterations of the nonlinear PCG method, be chosen such that the following 
inequality 

(l-8 n )S + S n <8, 
has a solution 8 € [0, 1). A sufficient condition for this is 

1 



Then we have the following uniform estimates 

(3-19) \\v-B k [A k v}\\ 2 Ak <S\\v\\l k , 
(3-20) \\v-B k [A k v]\\ 2 Ak <8 n \\v\\ 2 Ak , 

where 8 is independent ofk. 

Proof. Assume that ([339]) and fl3~2"P|) hold for k- 1. Similar to Theorem [331 we 
have 

(v - B k [A k v],w) Ak =(v- B k - 1 [A k - 1 P k ^ 1 v],w) Ak 
(Cauchy Schwarz) < \\v - P k -iv\\ Ak \\w - P k ^\w\\ Ak 

+ \\P k - lV - B^A^P^lUJP^wU, 
(Induction Assumption) < ||<u - P k -iv\\ Ak \\w - P k ^iw\\ Ak 

+ 8^ 2 \\P k ^v\\ Ak \\P k ^w\\ Ak 

(Cauchy Schwarz) < \\v - P k _ lV \\ Ak + 6™\\P k ^v\\ Ak 




The first term on the right hand side can be estimated by the same argument as in 
Theorem 13.71 therefore, we have 

(v - B k [A k v],w) Ak <<5 1/2 |MUJMU fc , 

this implies (13.191) . Moreover, According to Theorem 12.11 and letting / = A k v 
in (|2.11l) . the estimate f|3 . 20[) follows directly. 

The existence of 8 has been shown in Theorem 13.71 □ 

For ko = 1 and n — 2, the nonlinear AMLI-cycle MG has the complexity of 
W-cycle MG, and the sufficient condition (13. 16)) becomes 
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In conclusion, we have the following result. 

Corollary 3.9. If the two-grid method at any level k (with exact solution at 
coarse level k+1) has a uniformly bounded convergence rate 6 < h, then the respective 
nonlinear AMLI-cycle MG with n = 2 converges uniformly. 

Remark 3.2. Since Theorem 12.11 holds for both full and truncated version of the 
nonlinear PCG methods, the above uniform convergence estimates also hold for both 
full and truncated version of the nonlinear PCG methods. 

3.3. Comparison Analysis. Without Assumptions 12.11 and 12.21 although we 
cannot show that the nonlinear AMLI-cycle MG is uniformly convergent, we can 
compare it with the nonlinear AMLI-cycle MG with the corresponding nonsymmetric 
(\-cycle) and symmetric (V-cycle ) MG. In this section, we show that the nonlinear 
AMLI-cycle is always better (or not worse) under the assumption that smoother is 
convergent in the || • l^-norm. 

The first comparison theorem concerns with the nonsymmetric nonlinear AMLI- 
cycle MG and \-cycle MG. It shows that both the nonlinear operator and B^ s 
give better approximations to the inverse of A k . 

Theorem 3.10. Let and B" s [-} be defined by Algorithm^ and\K]\ , 
and B^ s [-] be implemented as in Algorithm \2.3\ with B^ s [-] used as preconditioner. 
Then we have 

(3-21) \\v - B n k s [A k v]\\ Ak < \\v - B n k s A k v\\ Ak . 

(3-22) \\v - B}»[A k v]\\ Ak < \\v - BZ'A k v\\ Ah . 

Proof. We use mathematical induction to prove the theorem. Assume that (|3. 211) 
and (|3.22j) hold for k - 1. By Algorithm [27Q we have 

(3.23) (I-B% s A k )v = v-B£L 1 A k - 1 P lt - 1 v =v-P k . l v + P k . l v-B^_ 1 A k ^P k _ l v, 
where v = (I — R k A k )v as before. Note that P k ~i is a projection, hence we have 

(3.24) || V - Bl s A k vf Ak = \\v P k - X v\\\ k + \\P k -xV - B^A^P^if^ 

Similarly, for the nonlinear operator B^ s [-], by Lemma 13. 11 we have 

|| V - Bl s [A k v] f Ak = \\v P k - lV f Ak + \\P k ^v 
(3-25) < \\v - P k _ lV \\ 2 Ak + \\P k _ lV 

= \\v B^A k vf Ak 

Then p.2ip follows. Moreover, since B£ 3 [A k v] is obtained by Algorithm 12.31 with 
B r k ls [-} used as preconditioner, by (|2.8p . we have 

(3.26) \\v - B^[A k v]\\ 2 Ak < \\v-Br[A k v]\\ 2 Ak < \\v - B£ s A k v\\ Ak . 

This completes the proof. □ 

As before, we only used the minimization property (|2.8j) in the proof, therefore, 
Theorem 13.101 is also true when we use any truncated version of the nonlinear PCG 
method to define the coarse level solver. Thus, we have the following corollary. 



~ B^lAk-iPk-ivWW, 
- B^Ak^P^vf^ 
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Corollary 3.11. Let and B^ s [-] be defined by Algorithm ic. 11 and \2.4\ Let 
also B k ls [-\ be implemented as in a truncated version of Algorithm ic. 3\ with B' k ls [-] as 
preconditioner. Then, we have 

\\v-BnA k v}\\ Ak <\\v-BrA k v\\ Ak , 
\\v-BnA k v}\\ Ak <\\v-B%°A k v\\ Ak . 

Next we show that, similarly to the nonsymmetric case, the nonlinear AMLI-cycle 
is better (not worse) than the respective V-cycle MG, and both nonlinear operator 
B k and B k provide better approximations to the inverse of A k ■ 

We first show the following key property of the nonlinear operator B k [•] obtained 
by Algorithm 12.31 This property plays an important rule in our analysis. 

Lemma 3.12. Let B k [-\ be implemented as in Algorithm \2.3\ with B k [-\ as precon- 
ditioner. For^v (zV k , we have 

(3-27) \\v - B k [A k v}\\ 2 Ak = (v-B k [A k v],v) Ah . 

Proof. By (|2.3p , we can see that Ui — X)}=o a oPo ■ Due to tne ^ act tnat tnc 
residual is orthogonal to all the previous directions pj, j — 0,1, ■ ■ ■ ,i — 1, we 
have (ri,Ui) = 0. By definition, B k [f] := u n , hence we have (r n ,u n ) = 0, r n = 
f - A k B k [f], i.e., 

(3.28) (f-A k B k [f],B k [f])=Q. 

Letting / = A k v, we have 

\\v - B k [A k v]\\ Ak =(v- B k [A k v],v - B k [A k v]) Ak 

= (v- B k [A k v],v) Ak +(v- B k [A k v],B k [A k v]) Ak . 

The second term vanishes due to (|3.28p and the choice / = A k v. Then (|3.27[) follows 
directly. □ 

Now we are in a position to show the following comparison theorem for the non- 
linear AMLI-cycle MG and the respective V-cycle MG. 

Theorem 3.13. Let B k [-} be defined by Algorithm 12. 5\ and B k [-] be imple- 
mented as in Algorithm 12.31 with B k [-] as preconditioner. We also assume that the 
smoother R k is convergent. For Vt> € V k , the following estimates hold: 

(3.29) < (v - B k [A k v],v) Ak < (v - B k [A k v],v) Ak < (v - B k A k v,v) Ah . 

Proof. Inequalities (|3.29p hold trivially for k = 1. Assuming by induction 
that (|3.29p holds for k — 1, by Lemma [333 we than have that 

(v - B k [A k v],v) Ak = \\v - B k [A k v}f Ak > 0, 

which confirms the first inequality in (|3.29p . Since B k [A k v] is obtained by Algo- 
rithm [531 with Bk[-] as preconditioner, by (|2.8p . we have 

(v - B k [A k v],v) Ak = \\v - B k [A k v]\\ 2 Ak < \\v - B k [A k v]\\\ h . 
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On the other hand, letting v = (I — R k A k )v, according to Lemma we have 



\\v - B k [A k v]f Ak = 


na- 


-R\ 


A k ){v - B k -i 


[A k - 


-iPk- 


-iv})\ 


X 




(smoother is convergent) < 


n«- 


B k - 


-i[A k -iPk-iv 


111 












ii«- 


Pk- 


IV + Pk-lV - 


Bk- 


i[A k 


-iPk 


-iv]\ 


\ 


(orthogonality) = 


[[*- 


Pk- 


lv\\A k + \\Pk- 


iv - 


B k - 


i[A k - 


-iPk 


-i«lll a ^ 






Pk- 


lv\\A k + WPk- 


iv - 


B k - 


i[A k - 


-iPk 


-i«lll a ^ 


(Lemma |3.12|) = 


(v- 


Pk- 


iv, v - Pk-iv 


A k 











+ (Pk-iv - B k -i[A k -\Pk-iv],Pk-iv)A k 
(orthogonality) = (v - Pk~iv,v)A k + (Pk-iv - Bk-i[A k -iPk-iv\,v) A k 
= (v — Bk-i[Ak-iPk-iv],v)A k 
= (v- B k [A k v},v) Ak . 



Therefore, we have 

(v - B k [A k v],v) Ak <(v- B k [A k v},v) Ak , 
which confirms the second inequality in p. 291) . For the last inequality, we have 
(v - B k [A k v],v) Ak = (v - P k -iV,v) Ak + (Pk-iv - B k -i[A k -iPk-iv},v)A k 

= (v - P k -iV,v)A k + (Pk-iv - Bk-i[A k -iPk-iv}, Pk-ii>)A k 
(induction assumption) < (v — P k -iv,v) Ak + (P k -iv - B k -iA k -iPk-iv, Pk-iv)A k 
= (v- P k ^xV,v) Ak + (P k -iv - S fe _ 1 A fc _ 1 P fc _ 1 ?),?)) Afc 
= (v- Bk-xA^xP^iv, v) Ak 
= {y- B k A k v,v) Ak . 

This confirms the last inequality in (|3.29[) and thus the proof is complete. □ 

Remark 3.3. We recall that Lemma 13.121 is based on the fact that the current 
residual ri is orthogonal to all previous search direction, which only holds for the full 
version of the nonlinear AMLI-cycle MG. Therefore, the full version of the nonlinear 
PCG should be preferred in practice than the steepest descent method or truncated 
version of the nonlinear PCG, since then we have guaranteed monotonicity as stated 
in Theorem 13.131 (which holds only if the full version of the nonlinear PCG method 
is applied). 

3.4. Comparison results under Assumptions I2TT1 and [2.21 We return now 
to the Assumption 12.11 and 12.21 Under these assumptions, we have the following 
comparison theorem which shows that the nonlinear AMLI-cycle MG is (strictly) 
better than \-cycle MG with a factor p < 1, which we specify in the following theorem. 

Theorem 3.14. Let B k [-} be defined by Algorithm \2.5l and B k [-\ be imple- 
mented as in Algorithm \2.3\ with B k [-] as a preconditioner. Assume that Assump- 
tion \2.1\ and \2. 6 A hold. We then have the estimates 

(3-30) ||v - B k [A k v]\\ Ak <p\\v- Bl s A k v\\ Ak 

(3.31) ||v - Bk[A k v]\\ Ak < p\\v - B^A h v\\ Ah , 



where p = 




< 1 which is a constant independent ofk. 
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Proof. Assume that p. 301) and (|3.31[) hold for k — 1. Denote (/ — R k A k )v by v 
as before. Then by Lemma 13.21 we have 

(v - B k [A k v],w) Ak ={v- Pk-iv + Pk-iv - B k -i[Ak-iPk-iv],w) Ak 

= (v - Pk-lV, w) Ak + (Pk-iv - Bk-l[Ak-lPk-lV\,w) A k 
= (V — Pk-lV, W - P k -lw) Ak 

+ (Pk-ii - Bk-i[A k -iPk-iv], P k ~iw) Ak 
(Cauchy Schwarz) < \\v - P k -iv\\ Ak \\w - P k -iw\\ Ak 

+ \\P k -iv - B k _ 1 [A k _ 1 P k _ 1 v]\\ Ak \\P k -iw\\ Ak 
(induction assumption) < \\v — Pk-iw||.A 1 J|'u) — Pk-iw\\ Ak 

+ p\\P k -iv - Bl^Ak-iPk-ivU, \\Pk-iw\W 
(Cauchy Schwarz) < yj\\v - P k -iv\\\ k + \\P k -iv - B^A k Z^P k ~I^\ h 

x ^\\w - P k - 1 w\\\ k + P 2 \\Pk-M\ 2 Ak 
= \\v - Bl s A k v\\ Ak x ^\\w ~ P k -iw\\\ k + p^\\P k -iw\\ 2 Ak 



Note that 

\\w - P k -iw\\ 2 Ak + p 2 \\P k ^w\\ 2 Ak = (1 - p 2 )\\w - P k - X w\\ 2 Ak + P 2 \\w\\ 2 Ak 

(Lemma^ < (1 - P 2 M\\™\\ 2 Ak ~ IHfeJ + P 2 \\w\\ 2 Ak 

= (i- P 2 )v\M 2 Ak + (p 2 -(i-P 2 )v)\\w\\ 2 Ak 

= p 2 \\w\\ 2 Ak (choose p 2 = 

Therefore, we have 

(v-B k [A k v},w) Ak < \\v-B^ s A k v\\ Ak x p\\w\\ Ak , 

which implies (|3.30p . Moreover, since B k [A k v] is obtained by Algorithm l2.3l with B k [-] 
as the preconditioner, by (|2.8[) . we have 

\\v-B k [A k v]f Ak < \\v - B k [A k v]\\ 2 Ak . 

Then (|3.31l) follows from the proven estimate (|3.30p . □ 

4. Numerical Experiments. In this section, we present some numerical results 
to illustrate our theoretical results. The first model problem we consider here is 

(4.1) -Au = f, in fl, 

(4.2) u = 0, on dfl, 

where Q is the unit square in R 2 . In our numerical experiments, we discretize equa- 
tion (|1.1[) by linear finite element method with the choice of / = 1. The domain Q, is 
triangulated by uniform refinements and the mesh size on the finest level is h = 2~ k , 
where k is the number of levels used. 
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In Table 14. 1[ the numerical results of nonlinear AMLI-cycle MG and V-cycle MG 
methods are presented and compared. Under the setting of our experiments, Assump- 
tion and [52] are satisfied, then according to Theorem l3.4[ both nonlinear operator 
Bk[-] and are uniformly convergent, which is illustrated with the numerical re- 
sults shown in Table |4~T1 Furthermore, we can see that Bk and Bk are better than 
Bk in terms of the number of iterations, which agrees with Theorem 13. 131 

Table 4.1 

Number of iterations of the V-cycle MG and nonlinear AMLI-cycle MG. (stopping criteria: 
relative residual is less than 10 — 6 ; N-PGG(n): n iterations of the nonlinear PCG is used to define 
the coarse level solver 





B k 


Bk[] 


Bk[-] 


k 




N-PCG(l) 


N-PCG(2) 


N-PCG(l) 


N-PCG(2) 


5 


9 


9 


9 


7 


3 


6 


11 


10 


10 


8 


4 


7 


12 


11 


10 


9 


4 


8 


13 


11 


10 


10 


4 


9 


13 


12 


10 


10 


4 


10 


14 


12 


10 


11 


4 


11 


14 


12 


10 


12 


4 


12 


14 


13 


10 


12 


4 



The second model problem is a diffusion equation with large jump in the coefficient 

(4.3) -V • (a(i)Vtt) = /, in fl, 

(4.4) u = 0, on dfl, 

where f2 = (0,1) x (0,1). We have a{x) = 1 on Oi =_(0.25_,0.5) x (0.25,0.5) and 
fl 2 = (0.5,0.75) x (0.5,0.75), and a(x) = 10" 6 on U fi 2 ). The domain Q is 

triangulated by uniform refinements and the mesh size on the finest level is h = 2~ k , 
where k is the number of levels used. In this test problem, we choose / = 0, which 
means the exact solution is u* = 0. Since we know the exact solution, the stopping 
criteria is ||tt* — Ui\\A < 10 -6 , where itj is the i-th iteration of the MG methods. 

It is well known that the performance of V-cycle MG methods for this jump 
coefficient problem will degenerate. Table 14.21 confirms this fact. For this problem, 
due to lack of regularity, if one iteration of nonlinear PCG methods is used to define 
the coarse level solver, both Bk[-] and Bk[-] appear to be non-uniformly convergent. 
Nevertheless, according to Theorem I3.13[ they exhibit better convergence than the 
V-cycle MG. Furthermore, if the number of iterations of the nonlinear PCG methods 
is sufficiently large (n = 2 in this case), according to the theoretical results in [18], 
we can expect that Bk[-] be uniformly convergent both with respect to the number 
of levels k and the jumps, which is demonstrated by the numerical results shown in 
Table l4~2l Furthermore, we see that also converges uniformly. 

In the last numerical experiment, we use unsmoothed aggregation AMG (UA- 
AMG) methods to solve model problem (|4.ip discretized by linear finite element on 
uniform meshes. Given the fc-th level matrix Ak & W lkXrLk , in the UA-AMG method 
we define prolongation matrix P£_i from a non-overlapping partition of the un- 
knowns at level k into rifc-i nonempty disjoint sets Gj, j — 1, . . . ,nk-i, which are 
referred to as aggregates. In our numerical experiments, we use Algorithm 2 in [2 3) 
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Table 4.2 

Number of iterations of the V- cycle MG and nonlinear AMLI-cycle MG for jump coefficient 
problem, (stopping criteria: energy norm of error is less than 10 — 6 ; N-PCG(n): n iterations of the 
nonlinear PCG is used to define the coarse level solver Bk — i[-]) 





B k 


Bk[-} 


Bu[] 


k 




N-PCG(l) 


N-PCG(2) 


N-PCG(l) 


N-PCG(2) 


5 


27 


15 


13 


13 


4 


6 


40 


22 


14 


15 


5 


7 


49 


29 


14 


20 


5 


8 


56 


37 


15 


30 


5 


9 


76 


45 


15 


42 


5 


10 


102 


55 


15 


47 


5 



to generate the aggregates on each level. Once the aggregates are constructed, the 
prolongator P^-i is a nj, x rik~i matrix given by 

i nfe \ J 1 if i € Gj . . 
(-Pfc-i)ij = S n ^ . i = l,...,n k , j = 1, . . . , rik-i- 
I otherwise 

With such piecewise constant prolongation P%-\> the coarse level matrix Ak-i € 
i"*- lXn *- 1 is defined by 

Since now we consider AMG methods, we do not have the orthogonal projections Qk 
and Pk, and cannot use them to define the operators Bk, ■£?*[•] and Bk[-]- However, 
thanks to the prolongation P k k _ 1 , the V-cycle MG iterator B k for UA-AMG is defined 
recursively by Algorithm 12.21 with the following coarse grid correction step, 

u 2 = ui + P£- 1 B k -. 1 {P£_ 1 ) t (f - A k ui). 

Similarly, the nonlinear operator B k [-] for UA-AMG is defined by Algorithm 12.51 with 
the following coarse grid correction step 

u 2 = ui + PtiBk-AiPtifU - AfcUl)], 

and the nonlinear operator Bk [•] for UA-AMG is implemented as in Algorithm 12.31 
with Bk[-] for UA-AMG as preconditioner. 

The results are shown in Table l4~3l We can see that if we use V-cycle MG for UA- 
AMG, the number of iterations depends strongly on the size of the problem. If we use 
one iteration of the nonlinear PCG to define the coarse level solver, the performance of 
Bk[-] and still depends on the size of the problem, but the number of iterations 
grows much slower. If we use two iterations, both Bk[-] and B/~[-] exhibit uniform 
convergence. 

The last experiments demonstrate the potential of the nonlinear AMLI-cycle MG 
methods in cases when the constructed hierarchy of interpolation matrices is not 
energy stable. In many cases it is straightforward to come up with simple (e.g., block- 
diagonal) interpolation matrices which however lead to V-cycle MG that generally has 
level-dependent convergence. The nonlinear AMLI-cycle can be used in such instances 
to substantially improve the convergence (cf., e.g., [14]). 
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Table 4.3 

Number of iterations of the V-cycle MG and nonlinear AMLI-cycle MG for the UA-AMG 
method, (stopping criteria: relative residual is less than 10 -6 ; N-PCG(n): n iterations of the 
nonlinear PCG is used to define the coarse level solver B^ — il']) 





Bk 


B k [] 


Bk[] 


Size 




N-PCG(l) 


N-PCG(2) 


N-PCG(l) 


N-PCG(2) 


3,969 


100 


48 


40 


34 


9 


16,129 


244 


70 


41 


38 


9 


65,025 


519 


94 


41 


56 


9 


261,121 


713 


93 


41 


63 


9 


1,046,529 


1753 


112 


40 


93 


9 
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